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Algebraic  Multi  grid  and  the  Fast  Adaptive  Composite  Grid 
Method  in  Large  Scale  Ccoputation 


Progress  of  this  project  is  categorized  into  the  two  areas  described 

below. 

I.  AMG.  JJhe  first  area  is  devoted  to  study  of  algebraic  multi  grid 
(AMG)  (cf.  ( 1)  —  (8 ) ) . 

Conventional  or  geometric  multigrid  algorithms  depend  on  knowledge 
of  the  underlying  geometry  for  a  given  problem  (e.g. ,  a  partial  differential 
equation) .  This  knowledge  is  used  to  predetermine  coarser  grids  and  the  atten¬ 
dant  operators  and  intergrid  transfers.  Although  very  efficient  solvers  can 
be  developed  in  this  way,  the  dissemination  and  use  of  geometric  multi  grid  have 
been  inpeded  by  the  need  to  tailor  the  algorithm  to  each  application.  A  fairly 
general?  "black  box'^olver  based  on  rml  ti  grid  principles  would  be  useful  in 
overcoming  these  difficulties.  ”\ln  fact,  AMG  is  such  a  scheme  that  has  many 
advantages  over  other  solvers  (cf .  (7) )  for  treating  many  complex  and  irregular 
problems  (cf.  the  introductions  to  (1)  and  (2)).  '  ^ r :  .  ( 

For  certain  classes  of  matrices  (e.g.,  symmetric  positive- type) ,  the 
project  has  established  AMG  as  an  effect  "black  box"  solver:  the  research  has 
shown  (2)  that  point  Gauss -Seidel  for  such  matrices  achieves  (algebraic) 
smoothness  in  the  sense  that  the  errors  after  just  a  few  sweeps  are  "locally 
constant";  that  is,  variables  that  are  strongly  oou  led  via  large  off-diagonal 
matrix  entries  must  have  similar  errors.  The  coarsening  process  may  therefore 
use  a  Ritz-type  variational  formulation  in  an  attempt  to  approximate  such 
errors;  that  is,  it  is  enough  to  determine  an  interpolation  process  that  ensures 
that  such  errors  are  approximately  in  the  range  of  interpolation.  Such  an 
approximation  property  must  be  achieved  while  maintaining  law  ocrplexity  of  the 
resulting  coarse- level  problems;  this  can  generally  be  acccrplished  by  an 
"operator"  interpolation  scheme  that  uses  the  matrix  to  determine  the  interpola¬ 
tion  coefficients.  More  critically,  the  coarse  grid  variables  thenselves  are 
chosen  automatically  in  this  scheme  so  that  they  properly  represent  the 
"strength"  of  the  fine  grid  equations.  Loosely  speaking,  each  fine  grid 


variable  that  is  not  reserved  for  the  ooarse  grid  must  have  only  strong 
couplings  to  variables  that  either  are  themselves  reserved  for  the  ooarse 
grid  or  are  strongly  ooupled  to  variables  that  are.  The  means  for  implementing 
this  "coarsening"  process  are  quite  intricate,  but  the  objectives  that  guide 
it  are  fairly  straightforward.  Moreover,  sharp  oonvergenae  rates  were  proved 
in  this  and  in  more  general  cases,  including  block  positive- type  matrices  such 
as  those  that  arise  from  discretizing  Stokes  equations  (cf.  (2)). 

The  main  difficulty  in  applying  AMG  to  new  classes  of  matrices  is  one 
of  determining  the  sense  of  smoothness  (of  relaxed  errors)  for  these  classes. 

This  sense  is  usecT  as  a  basis  for  the  coarsening  process  to  determine  strong 
cou;  lings  and  for  interpolation  to  determine  how  to  "collapse"  the  operator 
(i.e.,  how  to  ignore  couplings  between  strictly  fine  grid  points  so  that  a  fine 
grid  variable  is  determined  purely  by  ooarse  grid  ones)  .  Automatic  ways  for  oorpu- 
tationally  detecting  the  sense  of  smoothness  that  use  preliminary  relaxation 
sweeps  were  one  cf  the  central  focuses  of  the  project. 

The  project  studied  AMG  applied  to  a  wide  variety  of  essentially  posi¬ 
tive-type  problems,  including  anisotropic  and  ill -behaved  diffusion  equations 
as  well  certain  nonsyimetric  problems,  especially  convection  dominated  diffu¬ 
sion  equations  (5) ,  (6) ,  and  same  purely  algebraic  problems  that  arise  in  geodesy 
(1) .  And  it  has  just  recently  been  established  for  many  problems  in  structural 
mechanics  and  fluid  flows  (14) .  Yet  there  is  a  need  to  continue  much  of  the 
present  efforts  to  extend  AMG  to  a  broader  class  of  problems,  applications  and 
machines,  and  to  develop  software.  There  are  currently  many  ideas  in  each  of 
these  directions  —  they  are  in  fact  quite  abundant  —  and  the  study  devoted 
effort  to  most  of  them.  The  project  was  impelled  by  important  application 
areas  where  AMG  seems  most  needed.  This  included,  for  exanple,  finite-element 
and  boundary -element  discretizations  in  structural  analysis  and  aerodynamics 
(the  main  topics  of  study) ,  moving  grid  applications  in  reaction-diffusion 
modeling,  and  many  adaptive  discretizations  applications. 

II.  FAC.  iThe  second  project  area  was  the  study  of  FAC  in  the  context 
of  multiprocessor  ocrputer  systems.  FAC  is  developed  for  elliptic  equations  •  < 
in  (9)  -  (11) ,  which  include  various  descriptions  of  basic  and  more  sophisti¬ 
cated  FAC  schemes.  Its  application  to  advanced  aorputers  is  documented  in 
(12)  -  (13). 


There  is  a  clear  need  for  local  resolution  in  many  physical 
phenomena.  Tor  exanple,  when  special  local  features  of  the  forcing  function, 
boundary,  or  coefficients  of  an  elliptic  boundary  value  problem  dictate  dis¬ 
cretization  error  characteristics  that  are  substantially  different  than  the 
globed  features  of  the  problem,  it  is  important  that  the  discretization  account 
for  this  locally.  The  presence  of,  say,  a  point  source  should  rot  dsnand  a  fine 
mesh  throughout  the  region.  Yet  this  objective  of  adapting  to  local  phenomena 
is  often  in  conflict  with  the  process  designed  to  solve  the  discrete  system. 

Many  linear  solvers  degrade  significantly  m  the  presence  of  different  discreti¬ 
zation  scales  and  discrete  "interfaces".  In  fact,  even  the  discretization 
process  itself  can  be  adversely  affected  by  this  objective:  for  finite  differences, 
it  is  problematic  to  develop  sound  difference  formulae  and  data  structures  to 
handle  nonuni  form  grids;  for  finite  elements,  this  objective  is  reflected  in 
the  substantial  overhead  costs  in  automating  the  discretization. 

It  is,  therefore,  important  to  develop  mesh  refinement  techniques  that 
are  both  efficient  as  well  as  systematic.  Many  existing  mesh  refinement 
methods  (especially  those  that  are  adaptive)  are  systematic  but  troubled  by  slow 
or  expensive  solvers;  many  others  (especially  MLAT-type  schemes  (16,  (17))  are 
efficient  but  can  be  somewhat  ad  hoc.  FAC  attempts  to  dr**  from  the  best  of 
both  approaches. 

The  need  for  hiefi  local  resolution  is  demanding  not  only  better 
nunerical  methods,  but  more  advanced  computing  systems  as  well.  Present  and 
future  computational  requirements  are  beyond  the  reach  of  expected  computer 
technological  advancements  and  last  therefore  be  addressed  by  advanced  archi¬ 
tectures.  This  is  especially  true  for  problems  that  require  hi^i  local  resolu¬ 
tion  because  one  of  the  basic  tenets  here  is  that  this  is  often  well  beyond 
present  machine  capabilities.  Parallel  architectures  appear  to  be  very  natural 
responses  to  such  computational  demands,  especially  in  conjunction  with  FAC 
since  it  partitions  the  local  computations  into  separate  independent  processes. 

The  combination  of  F PC  and  advanoed  parallel  systems  can  provide  a  very 
effective  tool  for  solving  a  wide  variety  of  large  scale  computational  models. 

The  recent  progress  of  the  project  on  linear  FAC  is  documented  in 
detail  in  (12)  attached.  To  summarize,  the  results  include  a  fairly  complete 
theoretical  treatment  of  convergence  and  its  rates  for  elliptic  problems;  a 
theoretical  treatment  for  the  case  Where  the  coarse  grid  operator  and/or  the 
fine  grid  operator  are  replaced  by  approximate  solvers;  a  discussion  of  hew  to 


construct  acceptable  composite  grid  operators;  numerical  results  for  two  types 
of  elliptic  problems ,  a  discussion  of  other  topics  such  as  removal  of  singular' 
ities  and  multilevel  FAC;  results  on  the  application  of  FAC  to  the  HEP;  com¬ 
plexity  analysis  of  FAC  for  multiprocessor  systems  (the  first  of  its  kind)  ; 
and  a  theoretical  and  practical  development  of  HQMG,  a  new  and  efficient  FAC 
method  for  eigenvalue  problems. 

HOC  (13)  is  a  fully  variational  multi  grid- like  method  for  solving 
differential  eigenvalue  problems.  It  has  been  successfully  applied  to  model 
problems  and  to  the  difficult  single  group  neutron  diffusion  problem  at  LANL 
in  cooperation  with  Joel  Derdy .  Initial  efforts  were  made  to  implement  an 
efficient  FPC  version  of  HQMG  (which  has  been  done  on  model  problems  only,  but 
with  great  success)  and  to  extend  these  oodes  to  multi  group  problems. 

Stephen  F.  McCormick,  Ph.D. 

Principal  Investigator 
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